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Abstract. Let {X„) be a sequence of random variables (with values in a 
separable metric space) and {N„) a sequence of random indices. Conditions 
for XjVjj to converge stably (in particular, in distribution) are provided. Some 
examples, where such conditions werk but those already existing fail, are given 
as well. 



1. Introduction 

Anscombe's theorem (AT) gives conditions for Xn^ to converge in distribution, 
where (A„) is a sequence of random variables and (A„) a sequence of random 
indices. Roughly speaking, such conditions are: (i) iV„ — >■ oo in some sense; (ii) A„ 
converges in distribution; (iii) For large n, Xj is close to A„ provided j is close to 
n. (Precise definitions are given in Subsection 13.21) . 

In particular, in AT, condition (i) is realized as 

(a) Nn/kn — > u, where kn > and m > are constants and fc„ oo. 

Under (a), it is very hard to improve on AT. The only possibility is to look for some 
optimal form of condition (iii). See e.g. [B]. 
But condition (a) is oftcn generalized into 

(a*) Nn/kn — > U, where U > is a random variable. 

For instance, condition (a*) suffices for Xn^^ to converge in distribution in case 
Xn = n~^/^ Yli7=i{^i ~ -^(^i)}' where (Z„) is an i.i.d. sequence with E(Z\) < oo. 
However, under (a*), convergence in distribution of A„ is not enough. To get 
converge in distribution of A^v^, condition (ii) is to be strengthened. 

One natural Solution is to request stähle convergence of A„ . This is made precise 
by a result of Zhang Bo [8 (Theorem [1] in the sequel). According to Theorem [TJ 
Xn^ converges stably (in particular, in distribution) provided A„ converges stably, 
condition (a*) holds, and some form of (iii) is satisfied. The Statement of (iii) 
depends on whether U is, or it is not, discrete. 

In this paper, Theorem [l]is (strictly) improved. Our main result (Theorem [2] in 
the sequel) has two possible merits. It does not depend on whether U is discrete. 
And, more importantly, it requests a form of (iii) weaker than the corresponding 
one in Theorem [T] Indeed, in Theorem [1] the asked version of (iii) does not involve 
the Nn- As a consequence, it potentially works for every sequence (A„) of random 
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times but it is also ratlier strong. Instead, in Theorem [21 we exploit a form of (iii) 
which is tailor-made on the particular sequence of random times at hand. 

A few examples, where Theorem [5] works but Theorem [T] fails, are given as 
well. We mention Examples [6] and [7] concerning the exchangeable CLT and the 
exchangeable empirical process. 

2. Stahle convergence 

Let X he a metric space and (fl, A, P) a probability Space. A kernet (or a random 
probability measure) on is a map K on n such that: 

— iir(aj) is a Borel probability measure on X for each u E ft; 

— Lü ^ K{lü){B) is ^-measurable for each Borel set B <Z X. 

For every bounded Borel function / : A" ^ R, we let K{f) denote the real random 
variable 

K{u){f )^ j f{x)K{u){dx). 

Let [Xn) be a sequence of A'-valued random variables on {Vt^A.P). Given a 
Borel probability measure ß on X , say that Xn converges in distribution to if 
= lim„ i?{/(X„)} for all bounded continuous functions / : A' — R. In this 

case, we also write Xn — X for any ^Y-valued random variable X with distribution 
/i. Next, let C „4 be a sub-cr-field and K a kernel on X . Say that A"„ converges 
G-stably to K if 

E{K{})\H]^\\mE{f{Xn)\H] 

n 

for a\\ H eG with P{H) > and all bounded continuous f : X ^ R. 

CJ-stable convergence always implies convergence in distribution (just let H ^ Q). 
Further, it reduces to convergence in distribution for Q — {0, il} and is connected 
to convergence in probability for G = A. Suppose in fact X is separable and take 

an X-valued random variable X on {i^,A, P). Then, X„ — > X if and only if Xn 
converges ^-stably to the kernel K — 5x- 

We refer to [3] and references therein for more on stable convergence. 

3. Results 

3.1. Notation. All random variables appearing in the sequel, unless otherwise 
stated, are defined on a fixed probability space (fi,^, P). 

Let (5, d) be a separable metric space. The basic ingredients are three sequences 

(X„:n>0), (iV„:n>0), (fc„ : n > 0), 

where the X„ are S-valued random variables, the Nn are random times (i.e., random 
variables with values in {0, 1,2,.. .}) and the fc„ are strictly positive constants such 
that fc„ — ^ oo. We let 

Mn{5) = max d{Xj.Xn) 

j:\n-j\<nS 

for all ri > and 6 > Q. Finally, K denotes a kernel on S. 
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3.2. Classical Anscombe's theorem and one of its developments. Let fi 

be a Borel probability measure on S. According to AT, for Xn„ to converge in 
distribution to /i, it sufßces that 

(a) Nn/kn — > u, where u > is a constant; 

(b) Xn converges in distribution to /u; 

(c) infä>o limsup„ P(M„((^) > e) = for all e > 0. 

Soon after its appearance, AT has been investigated and developed in various 
ways. See e.g. [5], [ü], [7], [E] and references therein. To cur knowledge, most 
results preserve the structure of the classical AT, for they lead to convergence of 
(in distribution or stably) under suitable versions of conditions (a)-(b)-(c). In 
particular, much attention is paid to possible alternative versions of condition (c). 
Also, as remarked in Section[l] condition (a) is often generalized into 

(a*) Nn/kn — > U, where U > is a random variable. 

Replacing (a) with (a*) is not free but implies strengtlicning (b) and/or (c). 
A remarkable example is the foUowing. In the sequel, U denotes a real random 
variable and G a sub-cr-field of A such that 

U >0 and <7{U) C g. 

Theorem 1. (Zhang Bo f8|). Let U be strictly positive and Q-measurable. Sup- 
pose condition (a*) holds and 

(b*) Xn converges Q -stably to K. 

Then, Xjs;^ converges Q -stably to K provided condition (c) holds and U is discrete. 
Or eise, Xn^ converges Q -stably to K provided 

(c*) For each e > 0, there is 5 > such that 

limsup P{Mn{5) > e\H) <e for all H e G with P{H) > 0. 

n 

Theorem [T] is our starting point. Roughly speaking, it can be summarized as 
foUows. Suppose (a*) and (c) hold but (a) falls. If U is discrete, Ajv„ still converges 
in distribution (in fact, it converges stably) up to replacing (b) with (b*). If U is 
not discrete, instead, condition (c) should be strengthened as well. 

3.3. Improving Theorem [TJ Suppose conditions (a*)-(b*) hold but U is not 
necessarily discrete. As implicit in Theorem [1] it may be that (c) holds and yet 
Xat^ falls to converge C/-stably to K; see ExampleSl Hence, to get X^^ ^ jtcdiiy 
condition (c) is to be modified. Plainly, a number of conditions could serve to this 
purpose. We now investigate two of them. 

One (crude) possibility is just replacing n with Nn in condition (c), that is, 

(d) infä>o limsup„ PI^Mn„{S) > e) = for all e > 0, 



where 
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Mm^{5)= max d{Xj,XM„). 

j:|JV„-j|<JV„ Ä 

Unlike condition (c*) of Theorem [U which works for every sequence Nn (as far as 
(a*) and (b*) are satisfied), condition (d) is tailor-made on the particular sequence 
of random times at hand. 

In view of (a*), another Option is replacing -M„((5) with 

j:\[k„ ;7]-jl<[fc„ U] s 

The corresponding condition is 

(e) infä>o hnisup„ F(A/[fc^ u]i.^) > e) = for aU e > 0. 

Conditions (d) and (e) are actually equivalent. More importantly, they lead to 
the desired conclusion. 

Theorem 2. Let U he strictly positive and Q-measurahle. Conditions (d) and (e) 
are equivalent under (a*). Moreover, 

g~stably j V Q-stably 

Xn„ — >■ " o,na X[k„u] — ^ ^ 

under conditions (a*)-(h*)-(d) (or equivalently (a*)-(h*)-(e)). 

Proof. Let Ä„ — [fc„ U]. We first show that (d) and (e) are equivalent under (a*). 

Suppose (a*) and (e) hold and fix J e (0, 1]. If |i?„ — iV^,i| < 5 Rn and j is such 
that \j - Nn\ < S Nn, then 

\j-Rn\ < \j-Nn\+ÖRn < 5 N,, + ö En < 2 5 i?„ + ö |Ä„ - iV„ | < 3 (5 i?„ . 

Hence, — A'„| < S i?„ implies 

Mn„ (S) < d{XR^ ,XnJ+ max d{Xj , Xr^ ) < 2 Mß„ (3 ö) . 

j:\j-B.„\<3S B.„ 

Given e > 0, it foUows that 

P{MnAS) > e) < P{\Rn -Nn\> SRn) + P{MrJ3S) > e/2). 

By (a*), Nn/Rn 1 so that lim„P(|i?„ - iV„| > SR,,) = 0. Therefore, 
limsupP(Afjv„((5) > e) < limsupP(Afß„(3(5) > e/2) 

n n 

and condition (d) foUows from condition (e). By precisely the same argument, it 
can be shown that (a*) and (d) imply (e). 
Next, assume conditions (a*)-(b*)-(e). Since 

d{XR^ ,XnJ< Mr^ {5) provided | i?„ - iV„ | < (5 i?„ , 

p 

conditions (a*) and (e) yield d{Xii^,XM^) — > 0. Thus, it suffices to prove that 
^ ^^^'^ K. To this end, for each 5 G (0, 1], define 

oo 

Us ^ 6 ^Q^u^s} S I{js<u<(j+i)S} and i?„((5) = [fc„ C/a]. 
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Since Us is discrete, strictly positive and t/-measurable, conditioii (b*) yields 

Xb.^(S) ^'^^^ K. Fix in fact iJ e ö witli P{H) > and let ^ H n {Us = j 6} 
for all j > 1. Then, (b*) implies 

limi?{/(Xß„(5)) I H} - lim^ii;{/(X[fe„,,]) I H,}P{H, \ H) 

3 

= J2 E{K{f) I H,]P{H, I H) = E{K{f) \ H] 

3 

for each bounded continuous /, where the sum is over those j such that P{Hj) > 0. 
Note also that, on the set {U > 6}, one obtains 



\Rn ~ RniS )| — Rn ^ Rn{5 ) = Rn ■ 



[knU] 



^ kniU-Us2) + l ^ kn6^ + l ^ ^ 

^ ^" — k U-1 ^ k S-l < ^ ^^^^^ 

Thus, for e > and large n, 

p(^d{XR^ , Xß„(ä2) ) > e) < P(C/ < S)+P{MrJ2S) > e). 

By condition (e) and since C/ > 0, it follows that 



(1) inf limsupP diXn^ , Xß„(,-2) ) > e = 0. 

o>0 n ^ ^ 

Finally, fix e > 0, G ö with P{H) > 0, and a closed set C C S. Let 
= {x e 5 : d{x, C) < e}. By there is 5 G (0, 1] such that 

limsupP(d(Xß„ , Xfl„(52) ) > e) < eP{H). 
With such a (5, since Xß^(ä2') ^ ^^^v obtains 

limsupP(Xß„ £C\H) < limsup|p(d(Xfl„ , ^^„(52) ) > e \ h) + p[Xr^(s2) &C,\H 
< e + linisupP(Xß„(ä2) G I -ff) <e + E{K{C,) \ H). 

As e ^ 0, it follows that limsup„ P(Xß„ G C | iJ) < E{K{C) \ H). Therefore, 

□ 



Xr^^ ^ ^tt^biy ^ ^-j^.g concludes the proof. 



Theorem [2] unifies the two parts of Theorem [T] ([/ discrete and U not discrete). 
In addition, Theorem [2] strictly improves Theorem [TJ In fact, condition (c*) implies 
condition (e) but not conversely. Two (natural) examples where (e) holds and (c*) 
falls are given in the next section; see Examples [5] and |6l Here, we prove the direct 
implication. 



Theorem 3. Let U he strictly positive and Q-measurahle. If condition (c) holds 
and U is discrete, or if condition (c*) holds, then condition (e) holds. 
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Proof. Let i?„ = [knU]. Suppose (c) holds and U is discrete. Then it suffices to 
note that, for each e > and u > such that P{U = u) > Q, one obtains 

limsup P{Mji^{S) > e\U = u) = limsup P(M[fe,^ „j ((5) > e \ U = u) 

n 11 

< P{U = u)-^ limsupP(M„((5) > e) — ^ as (5 ^ 0. 

n 

Next, suppose (c*) holds. Given e > 0, takc 6 > such that 

limsup P{Mn{ö) > e/2\H) < e/2 for all H e Q with P{H) > 0. 

n 

Fix u, 7 > and dehne H — {u — j<U<u + 7}. Take j and n such that 

\j-Rn\<{S/4:)Rn, fc„7>l, knU<2[knU]. 

On the set H, one obtains 

Ii - [kn u] I < |j - i?„ I + - [fc„ u] I < (ö/i) Rn + I [fc„ U] - u] I 

2 

< ((5/4) fc„ (u + 7) + fc„ 7 + 1< [A:„ u] - {((5/4) (w + 7) + 2 7}. 

Letting 5* = (2/u) {(ö/4) (u + 7) + 27}, it follows that 

Mr^ ((5/4) < Af[fc„ (r ) + d(Xfi„ , „]) < 2 M[fc,. {5*) 
on for large n. Since H E Q, 

linisupP(Mfl„(V4) > e I i?) < limsup P(Af[fe„ ((5*) > e/2 | i?) 

n n 

< limsupP(M„((5*) > e/2 I iJ) < e/2 

n 

provided P{H) > and m, 7 are such that 5* < S, or equivalently 

7 (5 
ü - 8 + (5' 

Finally, take < a < 6 such that P(a < C/ < 5) > 1 - (e/2). The set {a < U < b} 
can be partitioned into sets Hi = {m^ — 7 < U < u,; + 7} such that (7/a) < S/{8 + S) 
and ui = a + 7 < 7/2 < . . .. On noting that {'j/ui) < 6/(8 + ö) for all i, 

limsupP(Mfl„((5/4) > e) < e/2 + lim sup P(Affl„ ((5/4) > e, a < U < b) 

n n 

< e/2 + ^limsup P(Mfl„ ((5/4) > e | H,) P{H,) < e 

n 

where the sum is over those i with P{Hi) > 0. This concludes the proof. □ 

4. EXAMPLES 

It is implicit in Theorem [T] that, when U is not discrete, conditions (a*)-(b*)-(c) 
are not enough for X^r„ ^ _stqbiy ^ ^-^^j^gj-g jg |;j^g kernel involved in condition 
(b*)). However, we do not know of any explicit example. So, we begin with one 
such example. 

Example 4. (Conditions (a*)-(b*)-(c) do not imply Xjv„ ^ ^f'^'-v 

= [0, 1), A the Borcl (T-field and P the Lebesgue measure. For each n > 1, define 

A„ = [logn, log(n + 1)) modulo 1, 
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that is, Ai = [0, log 2), A2 ^ [log 2, 1) U [0, (log 3) - 1) and so on. Define also 

Xq = and X„ — Ia„ for n> 1. Since P(v4„) — log((7i + l)/n), then Xn — > 0, or 
equivalently X„ converges ^-stably to the point mass at (see Section[2l). Thus, 
condition (b*) holds with Q = A and K the point mass at 0. Given e > 0, 

p(M„(<j)>.,x„=o)<p( u A,)< y: piA,)< log 

j:\n-j\<7iS j:\n-j\<n5 

Since P(X„ = 0) — ^ 1, it foUows that 

linisupP(M„((5) > e) = linisup P(Af„((5) > e, X„ = O) < logÜ^, 

n n 1 O 

that is, condition (c) holds. Finally, define U{uj) = cxp (w) for all ui G [0, 1) and 

Nn = [U exp(r„)], 

where the r„ are non-negative integers such that r„ — > cx). Condition (a*) is trivially 
true. Further, for each n, one obtains {iV„ — k} C Ak for all k, so that X^^ = 1. 
Thus, Xn^ falls to converge ^-stably to the point mass at 0. 

We next prove that condition (e) does not imply condition (c*). We give two 
examples. The first is just a modification of Example |4l while the second (which 
requires some more calculations) concerns the exchangeable CLT. Recall that (d) 
and (e) are equivalent under (a*). 

Example 5. (Example |4] revisited) . Conditions (b*)-(c)-(c*) depend on (X„) 
and Q only. In vicw of Theorem [1] condition (c*) falls in Example Hence, to 
build an example where (c*) falls but (a*)-(b*)-(c)-(d) hold, it sufßces to suitably 
modify the random times Nn of Example IH Precisely, suppose {il,A,P), U, (Xn) 
and G are as in Example [H but the random times are now 



where r„ = inf{j ■ j > Pn-i and Xj = 1} and A'o = Tq = 0. 



Then, (c*) falls while (b*)-(c) hold. It is not hard to see that T„ — [exp {n — 1) U] 
for n > 1. Thus, conditions (a*) and (d) are both trivially true. (As to (d), just 
note that T„_i < Nn{l- S) < Nn {1 + S) < T„ for large n and small S). 

Example 6. (Exchangeable CLT). Let (Z„ : n > 1) be an exchangeable se- 
quence of real random variables with tail a-field T. By de Finetti's theorem, (Zn) 
is i.i.d. conditionally on T- Basing on this fact, if E{Zf) < cx), it is not hard to see 
that 

T,t=l{Zt - E{Zi I r)} A-stably ^ 

where L = E{Zf \ T) - E{Zi \ T f and iV(0, cr^) denotes the Gaussian law with 
mean and variance (with A^(0,0) the point mass at 0); see e.g. Theorem 3.1 
of [1] and the subsequent remark. Fix a T-measurable random variable U > and 
define 

Nn = [nUl Xo = 0, X„ . aii^L_£(^LLn}. 
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Then, conditions (a*)-(b*)-(c)-(d) are satisfied (with Q ^ A and K = N{Q,L)) so 
that 

E{Zi I T)} A-stably 



because of Theorem [21 Indeed, (a*)-(b*) are obvious and (c) can be checked pre- 
cisely as (d). As to (d), given e > 0, just note that 

hmsup P{Mn^{S) > e I r) < hmsup P{Mn{S) > e | T) a.s. 

n n 

for Nn is T-measurable, and 

hmsup P(A/„(^) > e I r) ^ as (5 

n 

for (Zn) is i.i.d. conditionahy on T. Thus, 

hmsup P(A/jv„((5) > e) < / hmsup P{Mn^{S) >e\T)dP 

n J n 

< I hmsup P{Mn{S) >e\r)dP — ^ as 5 ^ 0. 

J n 

It remains to see that condition (c*) may faiL We verify this fact for 
g = a{U) and Z„ = [/ 14 

where 

• [/ is any random variable such that U > 0, E{U'^) < oo and P{U > u) > 
for ah u > 0; 

• {Vn) is i.i.d., Vi ^ N{0, 1), and (F„) is independent of U. 

Such a sequence (Z„) is exchangeable and E{Z'() = E{U'^) < oo. Furthcrmore, 
E{Zi I T) = a.s. and U is T-measurable (up to modihcations on P-null sets) for 

En y Y^n T/ Y^n y2 V^" t/2 

n n n n 

Next, a direct calculation shows that 

Z^z=i ^ Z^j=i * -.Ar(o, 2-2y^V^) forl<n<TO. 



Thus, conditionahy on U, 



where S € (0, 1) and 



Dehne = {f/ > u} and f{ö) = 2 V2^^27r^ for some m > and ,5 G (0, 1/2). 
Letting $ denote the Standard normal distribution function, for each n such that 
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n — [n {1 — 6)] < n 2 S, one obtains 

P{Mni2S) > 1/2 I H) > P(|X„ -X[„(i_ä)]| > 1/2 I i/) 

^P{H)-^ y^p(|X„-X[„(i_^)]| > 1/2 I U) dP 

Since P{U > u) > for all m > 0, condition (c*) (applied with e — 1/2) would 
imply *ä>(— < 1/4 for some fixed S and all m > 0. But this is absurd for 
lim„_>oo uf{S) ) ~ '^(^) ~ Therefore, (c*) falls in this example. 

Our last example deals with empirical processes for non independent data. Let 
Z°°(R) denote the Space of real bounded functions on M equipped with uniform 
distance. 

Example 7. (Exchangeable empirical processes). Again, let (Z„ : n > 1) be 

an exchangeable sequence of real random variables with tail cr-field T. Let P be a 
random distribution function satisfying 

F{t) = P{Zi <t\T) a.s. for all t G M. 

The n-th empirical process can be defined as 

n 

Xn{t) = ^/^{(l/n) Y,hz.<t] - F{t)^ for t e M. 

1=1 

Dehne also the process X{t) = B(F(t)), t e M, where B is a Brownian-bridge pro- 
cess independent of F. (Such a B is available up to enlarging the basic probability 

Space (J7,^, P)). If P(.^i = Z2) = or if Zi is discrete, then Xn — ^ X in the 
metric space /°°(R); see [I]-|2] for details. But 1°°{R) is not separable and working 
with it yields various measurability issues. So, to avoid technicalities, we assume 
< Zi <1 and we take S to be the space of real cadlag functions on [0, 1] equipped 

with Skorohod distance. Then, X„ X in the separable metric space 5"; see e.g. 
Theorem 3 of [2]. Actually, basing on de Finetti's theorem, it can be shown that 
Xn converges ^-stably to a certain kernel K on S. Precisely, for each distribution 
function 7J, let Qh denote the probability distribution (on the Borel sets of S) of 
the process Xnit) = B(i?(t)), t S [0, 1]. Then, K can be written as 

K{A)^Qf{Ä) for aU Borel sets A C 5. 

Finally, let Nn ~ [n U] where f7 > is any T-measurable random variable. Then, 
condition (a*) is trivially true, (b*) holds with Q — A, and (d) can be checked as 

in Example [ü] Thus, Theorem [5] implies Xn„ ^ J^'-y This fact can not be 
deduced by Theorem [U however, for condition (c*) may fail. 
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